Skip to content

Benchmark metrics#331

Closed
javaThonc wants to merge 8 commits intomicrosoft:mainfrom
javaThonc:benchmark_metrics
Closed

Benchmark metrics#331
javaThonc wants to merge 8 commits intomicrosoft:mainfrom
javaThonc:benchmark_metrics

Conversation

@javaThonc
Copy link
Contributor

update the effect of Tabnet on Alpha 360/158 dataset and SFM effect on Alpha 360 after fixing the bugs

@@ -0,0 +1,192 @@
{
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Why is this file necessary in this PR?

@@ -0,0 +1,157 @@
# Copyright (c) Microsoft Corporation.
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Why is this file necessary in this PR?

@@ -0,0 +1,62 @@
qlib_init:
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Why is this file necessary in this PR?

@@ -0,0 +1,157 @@
# Copyright (c) Microsoft Corporation.
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Why is this file necessary in this PR?

return super().load(name)

class HFSignalRecord(SignalRecord):
"""
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Why is this file necessary in this PR?

| ALSTM (Yao Qin, et al.) | Alpha360 | 0.0493±0.01 | 0.3778±0.06| 0.0585±0.00 | 0.4606±0.04 | 0.0513±0.03 | 0.6727±0.38| -0.1085±0.02 |
| GATs (Petar Velickovic, et al.) | Alpha360 | 0.0475±0.00 | 0.3515±0.02| 0.0592±0.00 | 0.4585±0.01 | 0.0876±0.02 | 1.1513±0.27| -0.0795±0.02 |
| DoubleEnsemble (Chuheng Zhang, et al.) | Alpha360 | 0.0407±0.00| 0.3053±0.00 | 0.0490±0.00 | 0.3840±0.00 | 0.0380±0.02 | 0.5000±0.21 | -0.0984±0.02 |
| SFM (Liheng Zhang, et al.)| Alpha360 | 0.0314±0.00 | 0.2389±0.02| 0.0407±0.00 | 0.3245±0.01 | 0.0127±0.01 | 0.1440±0.07| -0.1631±0.01 |
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

How many experiments have been run before you get this result ?
image

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I ran it 5 times. I will run the model again and update it.

@you-n-g
Copy link
Collaborator

you-n-g commented Mar 12, 2021

@javaThonc Besides, please resolve the conflicts.

@javaThonc javaThonc closed this Mar 18, 2021
you-n-g pushed a commit to you-n-g/qlib that referenced this pull request Aug 16, 2025
* change feedback tpl

* feedback tpl changes

* fix feedback tpl

* fix train.py of feedback tpl

* add rf model for feedback tpl

* fix CI
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants